Papers with en-de and de-en
Identifying Weaknesses in Machine Translation Metrics Through Minimum Bayes Risk Decoding: A Case Study for COMET (2022.aacl-main)
Copied to clipboard
| Challenge: | Neural metrics have a high correlation with human judgements but they are hard to eliminate due to their "black box" nature. |
| Approach: | They propose to use minimum bayes risk decoding to explore and quantify weaknesses in COMET models. |
| Outcome: | The proposed model is not sensitive enough to discrepancies in numbers and named entities, and is hard to remove by training on additional synthetic data. |